LSDNet: A Neural Network for Multisensory Perception
نویسندگان
چکیده
Infant Multisensory Perception Research on infant multisensory perception has detailed the increasing capacity of infants to differentiate stimuli when it is present to multiple sensory modalities (Bahrick (2002), Lewkowicz & Lickliter (1994)). Bahrick and Lickliters (2002) intersensory redundancy theory posits a two-fold thesis to explain infant and neonate multisensory perception. In the first thesis, infant attention is directed towards amodal features when redundant sensory information is present to two or more sensory modalities. Secondly, when only unimodal input is available, attention is directed towards modalityspecific features. Modality-specific features are particular for a given sensory modality (color, scent, pitch, etc), and amodal features are evident in multiple sensory modalities (rhythm, rate, tempo, intensity, etc). Our model attempts to replicate the overall computational structure to Bahrick and Lickliters theory and to offer validation to the two-fold thesis. Though their thesis is highly compatible to a computational approach, to date there have been no attempts to create such a model, and as such the LSDNet promises a new direction for multisensory research.
منابع مشابه
Multisensory contributions to the perception of vibrotactile events.
We argue that audio-tactile interactions during vibrotactile processing provide a promising, albeit largely neglected, benchmark for the systematic study multisensory integration. This article reviews and discusses current evidence for multisensory contributions to the perception of vibratory events, and proposes a framework to address a number of relevant questions. First, we highlight some of...
متن کاملA dynamical framework to relate perceptual variability with multisensory information processing
Multisensory processing involves participation of individual sensory streams, e.g., vision, audition to facilitate perception of environmental stimuli. An experimental realization of the underlying complexity is captured by the "McGurk-effect"- incongruent auditory and visual vocalization stimuli eliciting perception of illusory speech sounds. Further studies have established that time-delay be...
متن کاملIntegrated Multisensory Robotic Hand System for Deformable Object Manipulation
Designing a dexterous robotic hand able to interact intelligently with deformable objects constitutes a challenging area of research where many issues are yet to be solved. The complexity of such interactions requires the assistance of intelligent multisensory robotic systems that combine measurements collected from different sensors in order to accurately plan for the forces to be applied on t...
متن کاملLarge Scale Functional Brain Networks Underlying Temporal Integration of Audio-Visual Speech Perception: An EEG Study
Observable lip movements of the speaker influence perception of auditory speech. A classical example of this influence is reported by listeners who perceive an illusory (cross-modal) speech sound (McGurk-effect) when presented with incongruent audio-visual (AV) speech stimuli. Recent neuroimaging studies of AV speech perception accentuate the role of frontal, parietal, and the integrative brain...
متن کاملTitle : Neural Connectivity during Multisensory Episodic Memory in Schizophrenia
Copyright Information: All rights reserved unless otherwise indicated. Contact the author or original publisher for any necessary permissions. eScholarship is not the copyright owner for deposited works. Learn more at Evidence suggests that the core cognitive features of schizophrenia (SZ) include impairments in auditory and visual memory systems and that each of these deficits individually cor...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2004